Speech recognition with amplitude and frequency modulations

Speech recognition with amplitude and frequency modulations.

Amplitude modulation (AM) and frequency modulation (FM) are commonly used in communication, but their relative contributions to speech recognition have not been fully explored. To bridge this gap, we derived slowly varying AM and FM from speech sounds and conducted listening tests using stimuli with different modulations in normal-hearing and cochlear-implant subjects. We found that although AM...

Auditory-Visual Speech Recognition with Amplitude and Frequency Modulations

A recent study by Zeng et al (2005) [PNAS, 102, 2293-2298] demonstrated the importance of FM cues for auditory speech identification in a competing noise environment. The current speech identification study investigated this finding for both an Auditory Only (AO) and an Auditory-Visual (AV) speech in noise identification task. The results demonstrated an FM advantage (compared to AM only) for b...

Spectro-temporal Modulations for Robust Speech Emotion Recognition Spectro-temporal Modulations for Robust Speech Emotion Recognition

Coexistence of amplitude and frequency modulations in intracellular calcium dynamics.

The complex dynamics of intracellular calcium regulates cellular responses to information encoded in extracellular signals. Here we study the encoding of these external signals in the context of the Li-Rinzel model. We show that by control of biophysical parameters the information can be encoded in amplitude modulation (AM), frequency modulation (FM), or mixed (AM and FM) modulation. We briefly...

Extracting amplitude modulations from speech in the time domain

Natural sounds can be characterised by patterns of changes in loudness (amplitude modulations), and human speech perception studies have focused on the low frequencies contained in the gross temporal structure of speech. Low-pass filtering the temporal envelopes of sub-band filtered speech maintains intelligibility, but it remains unclear how the human auditory system could perform such a modul...